On the Spread of Random Interleavers 



Arya Mazumdar, Adrish Banerjee and A K Chaturvedi 
Department of Electrical Engineering 
Indian Institute of Technology 
Kanpur, India 
Email: {arya, adrish, akc}@iitk.ac.in 



o 
o 

(N 

o 

O 

cn 
(N 



CZ2 



> 

o 
o 

in 
o 

o 



X 



Abstract — For a given blocklength we determine tlie number 
of interleavers wliicli have spread equal to two. Using this, we 
find out the probability that a randomly chosen interleaver 
has spread two. We show that as blocklength increases, this 
probability increases but very quickly converges to the value 
1 fa 0.8647. Subsequently, we determine a lower bound 

on the probability of an interleaver having spread at least s. We 



show that this lower bound converges to the value e 
the blocklength increases. 



I. Introduction 

Interleavers play an important role in digital communica- 
tions over fading channels. They are also a key component of 
turbo codes [1][2][3]. A key characteristic of an interleaver is 
its spread. The notion of spread was initially introduced in [4] 
to take into account the short cycles [5] [6] which occur when 
two bits that are initially close to each other, remain close after 
interleaving. 

Spread has been redefined in [7] in the following way. Say, 
TT is a permutation on the set {0,1,2....,N-1}. The spread s of 
an interleaver is defined as. 



mm ( 



'j\n +k«-(^(j)U) 

0<z,j <^-l,^^J 



where 



\a — h\M = min(|a — h\,N — \a — h\). 



(1) 



(2) 



It is known that the maximum possible spread for an 
interleaver with blocklength iV is [4] [7] [8]. This paper 

seeks to address the question that if we randomly pick up an 
interleaver from the set of A^! possible interleavers, what is 
the probability that the spread of the interleaver is s, where 
2 < s < \\/2N J . We determine this probability for s = 2 
while for other values of s we determine a lower bound on the 
probability that the spread is at least s. We further determine 
this probability for the limiting case when the blocklength 
approaches infinity. Using these results it has been possible to 
determine a lower bound on the number of interleavers having 
a spread at least s for a given blocklength. 

The paper is organized as follows. In section II, a combi- 
natorial analysis is done with the help of [9] to find out the 
number of interleavers with spread two. The probability of 
a random interleaver having a spread two is also derived. In 
sections III and IV, a probabilistic analysis has been done to 



determine a lower bound on the probability that a randomly 
chosen interleaver will have spread at least s. We conclude the 
paper in section V. 



II. Interleavers With Spread Two 



An interleaver will have a spread of 2 if at least one pair 
of consecutive positions remains neighbors after interleaving. 
We will consider N-1 and as consecutive integers because 
according to the distance measure specified by (2), the distance 
between them is 1. It is clear that the minimum spread of an 
interleaver is 2. 

Clockwise and counterclockwise w-sequences have been 
defined in [9]. Clockwise w-sequences mean sequences such 
as {0, 1, ..w-l}, {1, 2, ..w}, {N- 2, iV- 1, 0, 1, ...w- 3} etc. 
while counterclockwise w-sequences mean sequences such as 
{w - 1, ui - 2, ..0}, {w, w - 1, ...1}, {w - 3, u; - 2, ...0, N - 
1, iV — 2} etc. The event of a permutation having spread more 
than 2 can be identified with the event of a permutation without 
any clockwise or counterclockwise 2-sequence. The number 
of permutations without any clockwise or counterclockwise 
w-sequences, Mo{N,w) is also given in [9]. We can find 
out the number of permutations without any clockwise or 
counterclockwise 2-sequences from that: 



AT-l i 

Mo{N,2) = iV! + ^(-1)'^2'^ 

i—1 a—1 

. a — 1 / \ a 



N 



N-i 
iN-i)l (3) 



Thus Mo(N, 2) is the number of interleavers of blocklength N 
with spread more than 2. A total of A^! interleavers are there. 
Say, Ks{N) is the number of interleavers of blocklength N 
with spread s. So the number of interleaver with spread equal 
to 2 is given by. 



i^2(iV) =iV!-Mo(iV,2) 



(4) 



From (3), the probability that a randomly chosen interleaver 



will have spread more than 2 is given by, 

Mo(iV,2) 



P{spread > 2) 



a 



Now consider the case when N 
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P{spread>2) = 1 + lim ^{-^f^'^'" 
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(6) 



For a < i the degree of N in each term inside the limit in 
(6) is negative and these terms go to zero as — > oo. The 
term with a — i goes to 1 as oo. 

So, from (6) as N ^ oo, 



P{spread > 2) = 1 + ^ 



(-2)' 



(7) 



So, as N oo, P{spread = 2) = 1 - e"^ = 0.8647. 

Thus it is fair to state that if we randomly pick an interleaver 
it is very likely that it will have spread 2. At the same time 
finding an interleaver with spread more than 2 is not very hard. 
In every « 8 random interleavers, there is hkely to be one 
with spread more than 2. Note that here we are considering 
large blocklengths. For finite blocklengths the probability that 
an interleaver will have spread more than 2 is lesser. 

The plot of (6) is shown in Fig.n(the upper curve). It shows 
that the probability, that an interleaver will have spread more 
than 2 gets very close to e^^ for blocklengths as small as 100. 

III. Interleavers With Higher Spread 

Theorem: If we randomly choose an interleaver from the 
set of all possible interleavers of blocklenth then. 



P{spread > s) > 



s-l 



{N - 2s + iy-^ .{N - 2s + 2) 
[N - 1){N - 2)...(iV - 2(s - 1)) 



N 



(8) 




Fig. 1 . The upper curve shows the exact probability of finding an interleaver 
with spread more than 2 as a function of blocklength. The lower curve gives 
the lower bound on the same, obtained from the tightened bound. 



Proof: 

Let As correspond to the event that a randomly picked 
interleaver has spread at least s. 

Let Ais be the event that for any fixed i 



K - i|jv + |7r(i) - 7r(j)|Ar > s 
V < J < iV - 1, 



It is clear that 



N-l 



P{As) = P( fl M 



(9) 



(10) 



i=0 



It was proved in [8] that for finite blocklength N spread is 
upper bounded by \^/2N J . Let us denote the maximum value 
of spread for blocklength N as Smax- Now, HiLo^^^s 7^ <i> 
only if s < Smax, otherwise P{As) — 0. 

Let us take any i. 7r(i) will be equal to k with probability 
j^. Let us take the case where 7r(i) = k. Now the interleaver 
TT will have spread more than s if 

VO<j<iV-l, j^i (11) 
Let us call the above event Aiks- Clearly 
P(A,,) = P(A,o.)P(7r(i) - 0) + P(Aa.)P(^(i) = 1) 

+ P{A,2s)P{7T{t) =2) + ... 

+ P{AiN-l)s)P{nil) = N - 1) 

N-l 



(12) 



k=0 



As mentioned earlier and — 1 are considered as 
neighbors and hence the entire arrangement of 0,...N-1 can 
be thought of as having a circular structure. So whatever may 
be the value of i or k (even if they are near or A^ — 1) the 



7r(; ± 1) should not belong to this interval 



...k-s+2 k-s+3 k-s+m+l....k-l k k+1. 



7r(i ± 2) titiould not belong to tins interval 



I 2 k-s+2 k-s+3 k-s 



...k-1 k k+1 k+s-i 



7r(z ± rn) slionkl not belong to this interval 



...k-s+2 k-s+3 k-s+m+l....k-l k k+1 k+s-m-1 k+s-3 k+s-I 



7r(i ± {s — 2)) should not belong to this uiterval 







...k-s+2 k-s+3 k-s 



...k-1 k k+1 k+s-i 



...k+s-3 k+s-2... 



7r(z ± (s — 1)} should not belong to this single point 
I 2 k-s+2 k-s+3 k-s+m+l....k-l k k+1 k+s-m-1 k+s-3 k+s-2 



Fig. 2. This shows the conditions for which Aj^j^g will be true. Here 7v(i) ■ 
k. So the conditions should ensure \i — j\^ + \k — 7r(j)|^ > s 



event Aiks will have the same probability. For the purpose of 
convenience in illustration we have taken i and k sufficiently 
away from or A'' — 1 in Fig. |2] 

Fig. 121 shows the conditions for which the event Aiks will 
be true. If 7r(z) — k then to have spread at least s, 7r(z zb 1) 
should not belong to the integer interval from A; — s + 2 to 
A; H~ 5 — 2, 7T{i ± 2) should not belong to the integer interval 
from /c — 5 + 3toA;H-5 — 3, and so on, as shown in Fig. |2l 

Say an integer interval from p to g is written as {p,q}. 
Then, as explained in Fig. 121 the event Aiks will be true if 



7r{i zb m) ^ {/c — 5 + m + 1, A: + 5 — m — 1} 

V 1 < 771 < 5 — 1 



(13) 



For a fixed to, let us call the event of (13) as Aiksm- It is 
clear that, 

s-l 

P{Aks) = Pif] Aksn^). (14) 



(15), i.e.. 



P{Aiksm\Aiksl ■-^iks2 • • ■ •^ifcs(m- 1) ) 

+ 1 - 2(.s - m) - 2(to - 1) 
N -{2m- 1) 
iV + 1 - 2(s - to) - 2(m - 1) - 1 
■ N - {2m - 1) - 1 

{N -2s + 3){N ~2s + 2) 
{N - 2m + 1){N - 2m) ' 



(16) 



From (14), 



iks2----Aiks{7n-l)) (17) 



m— 1 



(jV-2,s + 3)(jV-2,s + 2) 
{N-2m + l){N-2m) ^'''^ ^'^^ 

{N-2s + 3y-^.{N - 2s + 2)"-i 
{N - 1){N - 2)...{N - 2{s - 1)) ■ 



(18) 



We see that the right hand sides of (14), (16) and (18) are 
all independent of k, because whatever may be the value of 
7r(i), the probabilities are same. Now, from (12), 

P{A^s) 

1 (iV - 2s + 3)"-i.(A^ - 2s + 2)"-i 



N {N -\).{N -2)...{N -2{s-\)) 

(TV - 2s + 3)""i.(iV - 2s + 2)''^i 
{N -\){N -2)...{N -2{s-\)) ' 

So, as expected P{Ais) is same for all i's. 
We can write (10) as, 

Af-l 

P{A,) = [] P(A,,|Ao,.Ai,....^(,_i),) 

4=0 



(19) 



(20) 



Now, 



P{A^ ksrn ) 

— P([7r(z + to) ^ {/c — S + To + 1, fc + S — To — 1}] 
[^[7r(i — m) (f. {k — s + m + l^k + s — m — 1}]) 

= P{TT{i + m) ^ {k — s + m + l,k + s — m — 1}) 
■ P{[Ti{i - to) ^ {fc - s + to + 1, + s - to - 1}] 
I [7r(i + to) ^ {/j — S + TO + 1, fc + s — TO — 1}]) 
iV + 1 - 2(s - to) iV + 1 - 2(s - to) - 1 



N - 1 



iV-2 



(15) 



In a similar way, we can find out the conditional probability 
P{Ai},sm\Aiksi-Aiks2---A.,ks{m.-i))- ^ will be similar to (15), 
but as 2 (to — 1) points are already occupied because of 
Aiksi,Aiks2----Aiksi^rn-i) givcn, 2(to-1) should be subti-acted 
from the numerators and denominators of both fractions of 



i, P{Ais\AQs.Ais....A(i_^i-^s) = 0. But if interleaver 
with spread s exists, then it can be argued that the conditional 
probability of Ais, if Ais is true for i = 0, 1, .1 — 1, is larger 
than or equal to the unconditional probability of Aig. Hence, 

P{A,s\Ans-Ais.-A(,^i),)>P{A,s) for all Q<i<N-l 

(21) 

Thus we get the following inequality from (20) and (21), 

foi S ^ Sfyiax • 



P{As)f < P{As) 

(TV - 2s + 3y'^.{N - 2s + 2y-^ 



{N - 1).{N - 2)...{N - 2{s - 1)) 
This completes the proof of the theorem. 



N 



(22) 

< P{A,) 
(23) 



IV. Tightening the Bound 



If the event Ais is true for p — {s — 1) < i < p and p + 
(s — 1) > i > p, then Ajg will be true for i = p as well. So to 
have the event As, we need Ais to be satisfied for alH's except 
every (s — 1)*'*, because they will be then be automatically 
satisfied. Using this observation we now tighten the bound 
given in (8). Thus (20) can be written as, 



P{As) = l[P{Ais\Aos.Ais....A^i-i)s) 

i=0 

2s-2 

• Y\. P{^is\^0s-Ais---A(^s_2)sA(^s)s---^{i-l)s) 
i=s 

3s-2 

■ n ^(^i^\^0s---A(^s-2)s\s)s--^(2s-2)sA(28)s--\i-l)s) 
i=2s 

•• P(.^is\^0s--A(s-2)sA(^s)s--A(2s-2)sA{^2s)s--- 
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Fig. 3. Lower bounds on probability of spread at least s vs blocklength from 
(26), these bounds reach constant values as blocklength increases 



(iV - 2s + 3)*-i.(iV - 2.S + 2)"-!] ^"^^^ 



or 



{N -\){N -2)...{N -2{s-\)) 
< P{As) 



(26) 



which is tighter than (8). 



where is an integer such that ks < N — 1 but {k + l)s > 
iV - 1. In the last [^J terms of (24) the probabiUty of each 
{s — 1)*'* element satisfying Ais is expressed given all other 
elements satisfying Aig. Clearly each of these will be equal 
to unity. So (24) is simplified to 

s-2 

P{As) = Y[P{Ais\Aos.Au....A^i-i)s) 

2s-2 

• JJ P{Ais\Aos-Ais....A(^s_2)sA(^s^g....A(^i_i^g) 



If we multiply the left hand side of (26) with A^! we will 
get a lower bound on the number of interleavers with spread 
at least s. 



J2Kp{N) = NlP{As) 

p>s 



> m 



{N - 2s + 3y-\{N - 2s + 2y 



{N -1){N -2)...{N -2{s-l)) 



(27) 



z—s 
3s-2 



Expanding (26) and writing it as a product of 2(s — 1) 
fractions we get. 



. Yl P{Ais\Aos-Ai^s-2)sA(,)s-A{2s-2)sA(2s)s- P{^s) > 



=2s 



N-2s + 3N-2s + 3 N - 2s + 3 
N-1 ■ N-2 ""N-{s-l) 



■■■^{i-l)s) 



N-2S + 2 N-2s + 2 



■■ Yl. -P(^is|^0s--^(s-2)s^(s)s--^(2s-2)s^(2 

i—ks 

■ ■■■A(i-i)s) 



s)s" 



(25) 



(1- 



N-s ""N-2{s-l) 
2s -4 
N-1 

s-2 .jv-L^j___^ 



^ N-l' '"^ N-s + 1^ 



N-s' 



(28) 



Using an argument similar to (21), and the fact that there 
are N — [-^\ terms to be multiplied in (25), we get for 



To check what the bound turns out for large N, we take N 
oo. Using the result 



lim (1 - = e-°-^ 



(29) 
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s 

Fig. 4. Lower bounds on probability of spread at least s is shown as a 
function of s (from (26)) for different blocklength N. 

we get 

PiAs) > e-(2--4)^-T....e-(^-2)f^.e-(--2)f5f....i 



Thus the probabiHty of a randomly chosen interleaver 
having spread more than 2 (at least 3) for large blocklengths 
is lower bounded by e~^(^~^) = e~^, from (30). This bound 
exactly matches the result in (7). The bound in (26) is plotted 
in Fig. [2 (the lower curve) for s — 3. We can see from the 
figure that the tightness of the bound in (26) for s — 3, 
improves as blocklength increases. In the plot of the bound 
in Fig. [2 the ripples come because of the floor function in 
the expression of (26). It can be noticed that these ripples 
gradually decrease as the blocklength increases. 

We have plotted the probability bounds of (26) as a function 
of N in Fig. |3l It can be seen that the ripples which were 
prominent in the plot of the bound for s = 3 in Fig. [2 
are present in these plots also, but they are barely visible. 
We observe that each curve initially rises but then very 
quickly becomes almost horizontal indicating convergence to 
a limiting value. Further, as expected the curves for higher 
values of s are much below the curves for smaller value 
of s. The extremely small values of the probabilities need 
not necessarily mean that the number of interleavers with 
high spread is negligibly small because a lower bound on 
the number of interleavers is obtained by multiplying these 
probabilities by Nl. 

The lower bounds of (26) are plotted in Fig. 0] as functions 
of s for blocklengths 256, 1024 and 4096. We can see that the 
bounds for different blocklengths are quite close to each other 



There is very little separation between the curves for N — 
1024 and N = 4096. So for large blocklengths these bounds 
are almost independent of blocklength. From the values in the 
plots it is clear that if we randomly pick up interleavers, it is 
difficult to find an interleaver with high spread as the size of 
the search space needed to guarantee this is very large (search 
space size has the order e^''^^^' ). For blocklengths larger than 
1000, approximately 86.47% interleavers have spread 2. At 
least 13.53% interleavers have spread more than 2, at least 
0.0335% interleavers have spread more than 3 and at least 
1.52x10"^% have spread more than 4. For large blocklengths, 
the fraction of interleavers with spread more than s decays as 
fast as e^^(*~^' . Thus, it is fair to state that the expected 
spread of a random interleaver is a little more than 2. 

V. Conclusion 

We have addressed the problem of determining the number 
of interleavers of a given blocklength N that will have spread 
s. It has been possible to determine the exact expression for 
this number when s is equal to two. For other values of s 
lower bounds have been obtained on the number of interleavers 
having spread at least s. The probability that a randomly 
chosen interleaver will have spread two, converges quickly 
to 1 — e~^, as blocklength increases. The lower bound on the 
probability that a random interleaver will have spread at least 
s, converges to e^^*^"^^^ . 
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